Adaptive Memory Networks with Self-supervised Learning for Unsupervised Anomaly Detection
نویسندگان
چکیده
Unsupervised anomaly detection aims to build models effectively detect unseen anomalies by only training on the normal data. Although previous reconstruction-based methods have made fruitful progress, their generalization ability is limited due two critical challenges. First, dataset contains patterns, which limits model ability. Second, feature representations learned existing often lack representativeness hampers preserve diversity of patterns. In this paper, we propose a novel approach called Adaptive Memory Network with Self-supervised Learning (AMSL) address these challenges and enhance in unsupervised detection. Based convolutional autoencoder structure, AMSL incorporates self-supervised learning module learn general patterns an adaptive memory fusion rich representations. Experiments four public multivariate time series datasets demonstrate that significantly improves performance compared other state-of-the-art methods. Specifically, largest CAP sleep stage 900 million samples, outperforms second-best baseline 4%+ both accuracy F1 score. Apart from enhanced ability, also more robust against input noise.
منابع مشابه
Unsupervised and Semi-supervised Anomaly Detection with LSTM Neural Networks
We investigate anomaly detection in an unsupervised framework and introduce Long Short Term Memory (LSTM) neural network based algorithms. In particular, given variable length data sequences, we first pass these sequences through our LSTM based structure and obtain fixed length sequences. We then find a decision function for our anomaly detectors based on the One Class Support Vector Machines (...
متن کاملADAPTIVE ORDERED WEIGHTED AVERAGING FOR ANOMALY DETECTION IN CLUSTER-BASED MOBILE AD HOC NETWORKS
In this paper, an anomaly detection method in cluster-based mobile ad hoc networks with ad hoc on demand distance vector (AODV) routing protocol is proposed. In the method, the required features for describing the normal behavior of AODV are defined via step by step analysis of AODV and independent of any attack. In order to learn the normal behavior of AODV, a fuzzy averaging method is used fo...
متن کاملAn Overview of Deep Learning Based Methods for Unsupervised and Semi-Supervised Anomaly Detection in Videos
Videos represent the primary source of information for surveillance applications and are available in large amounts but in most cases contain little or no annotation for supervised learning. This article reviews the state-of-the-art deep learning based methods for video anomaly detection and categorizes them based on the type of model and criteria of detection. We also perform simple studies to...
متن کاملAnomaly Detection Analysis of Intrusion Data Using Supervised & Unsupervised Approach
Anomaly based network intrusion detection (ANID) is an important problem that has been researched within diverse research areas and various application domains. Several anomaly based network intrusion detection systems (ANIDS) can be found in the literature. Most ANIDSs employ supervised algorithms, whose performances highly depend on attack-free training data. However, this kind of training da...
متن کاملLearning Intrusion Detection: Supervised or Unsupervised?
Application and development of specialized machine learning techniques is gaining increasing attention in the intrusion detection community. A variety of learning techniques proposed for different intrusion detection problems can be roughly classified into two broad categories: supervised (classification) and unsupervised (anomaly detection and clustering). In this contribution we develop an ex...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Knowledge and Data Engineering
سال: 2022
ISSN: ['1558-2191', '1041-4347', '2326-3865']
DOI: https://doi.org/10.1109/tkde.2021.3139916